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ABSTRACT 



"The E-Rate in America" (February 2000) was one of the 



earliest efforts to assess the impact of the then-new federal program. In 
this second phase of the study, the Benton Foundation and the Center for 
Children and Technology continue to investigate the E-Rate while developing 
new tools to assist teachers, administrators, and policymakers in meeting 
some of the challenges discovered in the first phase of research. The 
Evaluation Toolkit presented in this document is part of this second phase of 
work, and is a work- in-progress . The Toolkit is designed to aid teachers in 
assessing the impact of technology-rich activities on skills development, 
student learning, and media literacy. This product builds upon the national 
ISTE (International Society for Technology in Education) , state, and local 
standards for general technology use by helping teachers determine how 
specific types of technology tools can be useful for promoting certain 
skills. The Toolkit currently focuses on five core areas of technology use 
commonly encountered in classrooms: Internet research; data collection and 
representation; live presentations; Web design; and illustrated reports. The 
Toolkit addresses the unique learning opportunities that each of these forms 
of technology use can bring to the classroom by first grouping the skills 
students must master within four categories: digital skills; media and 
meaning; point of view; and audience. Within these categories, the Toolkit 
gives teachers a sense of how student work might look at the beginning, 
intermediate, and advanced stages. Finally, the Toolkit moves from describing 
broad areas of skill and understanding to providing lists of specific skills 
that teachers might build into technology- rich lesson planning. The four 
pieces of the Toolkit (the Technology Affordances Matrix, the Conceptual 
Frameworks, the Checklists and the Evaluation Sample) are designed to work 
together to guide teachers through the process of planning, implementing, and 
evaluating technology-based lessons. (AEF) 
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The Benton Foundation and EDC’s Center for Children 
and Technology (CCT) have been funded by the Joyce 
Foundation to conduct a series of studies about the 
E-Rate, a federally managed program that provides sig- 
nificant discounts on telecommunications technologies to 
schools and libraries in the United States. Specifically, 
Benton and CCT have been studying the impact of the 
E-Rate on U.S. districts and schools. 

The first study, The E-Rate in America (www.benton.org/ 
e-rate/e-rate. 4cities.pdf) (published in February 2000), 
was one of the earliest efforts to assess the impact of the 
then-new federal program. It traced the ideas and politi- 
cal battles that led to the E-Rate’s establishment and 
recounted the practical issues confronting school 
districts as they sought to benefit from E-Rate resources. 
We found that although E-Rate funding opened up access 
to new network resources at the classroom level, it also 
raised many new challenges for educators by creating the 
need for revised curricula, improved in-school communi- 
cation, and new kinds of technical support and profes- 
sional development for teachers. 



In the second phase of work, the Benton Foundation and 
CCT have continued to investigate the E-Rate while 
developing new tools to assist teachers, administrators, 
and policymakers in meeting some of the challenges 
discovered in the first phase of research. The Evaluation 
Toolkit presented here is part of this second phase 
of work, and is a work-in-progress. The Toolkit is intend- 
ed to help policymakers, administrators, and teachers 
determine how specific types of technology tools can be 
useful for promoting certain skills. 
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DESCRIPTION OF THE TOOLKIT 



The Evaluation Toolkit, currently being developed in 
collaboration with teachers and administrators in Chicago 
and Milwaukee, is designed to aid teachers in assessing 
the impact of technology-rich activities on skills develop- 
ment, student learning and media literacy. This product 
builds upon the national ISTE (International Society for 
Technology in Education), state, and local standards for 
general technology use by helping teachers determine 
how specific types of technology tools can be useful for 
promoting certain skills. 

The Toolkit will help teachers and administrators deter- 
mine what level of sophistication students have attained 
in their technology use, will give teachers strategies to 
define clear learning objectives for technology-related 
lesson planning and will provide concrete examples of 
how students might attain these objectives in their work. 

The Toolkit currently focuses on five core areas of tech- 
nology use commonly encountered in classrooms: 

Internet Research 

Data Collection and Representation (i.e. spread- 
sheets and graphing tools) 

Live Presentations 
Web Design 
Illustrated Reports 



The Toolkit addresses the particular affordances (unique 
learning opportunities) that each of these forms of tech- 
nology use can bring to the classroom by first grouping 
the skills students must master within four categories: 

Digital Skills: The student can execute the mechanics of 
technology use. 

Media and Meaning: The student can both convey ideas 
in the various forms made available by technology and 
decide which form best delivers her message. 

Point of View: The student can make decisions about 
media - including decisions about text, visuals, sound 
effects and overall presentation format - that are direct- 
ed by the opinions she intends to express in her work. 
Audience: The student considers which media would 
most effectively and compellingly convey her message to 
particular audiences. 

Within these categories of skill, the Toolkit gives teachers 
a sense of how student work might look at the Beginning, 
Intermediate and Advanced stages. 

Finally, the Toolkit moves from describing broad areas of 
skill and understanding to providing lists of specific skills 
which teachers might build into technology-rich lesson 
planning. 

The four pieces of the Toolkit (the Technology Affordances 
Matrix, the Conceptual Frameworks, the Checklists and 
the Evaluation Sample, as described in more detail in the 
section, "How the Toolkit Will Be Used") are designed to 
work together to guide teachers through the process of 
planning, implementing and evaluating technology-based 
lessons. 



O 

ERLC 



6 



HOW THE TOOLKIT WILL BE USED 
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The four pieces of the Toolkit are the Technology 
Affordances Matrix, the Conceptual Frameworks, the 
Checklists and the Evaluation Sample. All of these tools 
are designed to aid educators in (1) determining stu- 
dents’ current level of facility with technology, (2) design- 
ing technology-rich lessons with concrete objectives and 
student learning goals in mind and (3) assessing student 
work with technology. Each tool serves a different stage 
in this process, as described below. 

I. The Technology Affordances Matrix: Entry point 
to the rest of the Toolkit. The Matrix will list the most com- 
mon forms of student work with technology - Web 
Design, Data Collection and Representation, Information 
Gathering, Live Presentations and Illustrated Reports - 
and will also broadly introduce the learning opportunities 
that each area of technology use can afford to students. 
At this point, educators can begin to consider which form 
of technology work would best promote their larger learn- 
ing goals for students. 

II. Conceptual Frameworks: Diagnostic tools. For 

each type of work described in the Technology 
Affordances Matrix (e.g. Live Presentations or Internet 
Research), the Conceptual Frameworks will divide the 
four skill areas of Digital Skill, Media and Meaning, Point 
of View and Audience (see Description of the Toolkit for 
definitions of these skill areas) into Basic, Intermediate, 
and Advanced skills and provide essential descriptions 
of each skill level. Teachers will be able to use the 
Frameworks as roadmaps to determine students’ levels 
of technology use, and focus upon the kinds of skills the 
students must learn to become more sophisticated 
users. In other words, teachers will be able to use the 
Frameworks to understand the trajectory of skill in each 
particular skill area for each type of student work with 
technology. 



III. Checklists: The “meat” of the toolkit While the 
Conceptual Frameworks will provide general descriptions 
of skill areas, the Checklists will give teachers concrete 
descriptions of specific skills for students to learn. For 
example, where the Media and Meaning affordance in the 
Framework says broadly that an Advanced live presenta- 
tion would be one in which, “different forms of represen- 
tation are used to highlight different aspects of the infor- 
mationT the Checklists will direct teachers to look at 
specific components of a live presentation. The 
Checklists are flexible tools; teachers can pull from the 
Checklists when planning lessons or when designing 
rubrics to assess student work. 

IV. Evaluation Sample: How the Toolkit can be used with 
student work. While the Checklist provides teachers with 
specific skills that students should learn, the Evaluation 
Sample gives teachers a model of how to apply the 
Checklist to a piece of student work. The student exam- 
ple is accompanied by a marked checklist that outlines 
the areas that the student has mastered while also pro- 
viding indications of where the student work needs 
improvement. 
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A PATH THROUGH THE EVALUATION TOOLKIT 
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Point of Vim 


Aud*«nc« 
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Cresting KidPix or PowerPoint slides to 
accompany live narration. Knowing how 
to bring text or illustrations from the 
Internet or clip art. Knowing how to use 
digital cameras and incorporate footage 
into the presentation (where applicable). 


Using visual aids (e.g.. slides) and 
Ordering them to enhance message of 
report. Understanding that visual and 
oral components of presentations can 
be different but complementary to One 
another, and increase the strength of a 
presentation, rather than repeat each 
other. 


Understanding how different features of 
presentations (e.g., transitions, effects, 
illustrations) can be used to convey the 
student's point of view and highlight 
underlying messages (e.g.. using a horn 
sound for a report about NYC. rather 
than a machine-gun sound). 


Understanding the need to toko the 
audience Into account when choosing 
effects to highlight points. Being able to 
field questions by interpreting slides . 
(e.g., one would not use the some visu- 
al aids for a report on music to 
teenagers as one would to adults). 




Downloading and printing or cOpy/past- 
ing Illustrative material for inclusion in 
text documents. 


Using non-text elements in a way that 
exceeds a decorative purpose. 
Understanding that different media 
types (e.g.. text, photos, sound, illustra- 
tions. etc.) have unique benefits and 
limitations (i.e.. being able to use sound 
or pictures to add information or to clar- 
ify or comment on key points). 


Understanding how media choices do 
not merely Illustrate content, but can 
also convey the author's specific point 
of view or message (e.g.. showing a 
striking, rather than resting, cobra in a 
report on snakes). 


Understanding that if illustrations are to 
enhance the content of a report, they 
must me chosen with the audience in 
mind (e.g.. One would not uso the same 
visual aids for a report delivered to 12th 
graders as one would use (or a report 
delivered to kindergartnere). 
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Creating stand alone web pages with 
text, images and navigation buttons. 


Understanding that information can be 
presented in a nonlinear fashion. Using 
a combination of text, visuals and sound 
to convey meaning, and utilizing nonlin- 
ear navigation to organize the flow of 
information. 


Understanding how different points of 
view can be included in the same 
nonlinear tex‘ (e.g., a home screen that 
presents a question about the 

value of free it- .re that links to multiple 
pages that present arguments for and 
against). 


Understanding how nonlinear informa- 
tion con provide opportunities for 
diverse audiences to pursue their indi- 
vidual interests within a single docu- 
ment. Understanding that web pages 
offer opportunities for audience interac- 
tion through links, discussion boards, 
online surveys, etc. 






Locating and downloading or copy/past- 
ing information from Internet or CD- 
Rom. 


Understanding that non-text media 
forms (e.g.. pictures or sound) can not 
only illustrate the text, but can also 
carry information of their own. 


Understanding that 
information is never 

completely neutral but always framed by 
the author/source's point 
of view. 


Understanding that authors tailor their 
uses of different media types to reach a 
certain audience (e.g.. a political car- 
toon in the New fork Times Is crofted to 
communicate to a very different audi- 
ence than a photo montage In a skate- 
boarding magazine). 
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Using spreadsheet software (e.g.. 
Excel) to organize data and create 
charts, graphs and tables. 


Understanding which data should bo 
represented visually (e.g.. number of 
students in a school might be graphed, 
or the demographics of a number of 
students in each grade might be). 


Understanding that particular types of 
data are best represented by particular 
types of graphs/charts (e.g.. pie chart 
versus bar graph), and that choices 
about graphical representation can 
impact a viewer‘3 comprehension of 
data and findings. 


Knowing how to vary the ways one rep- 
resents data to sway or convince a par- 
ticular audience (e.g.. to emphasizo the 
Increasing number of bicycle accidents 
over a five-year period, data is better 
represented In a bar or lino graph than 
in a pie chart). 



I. TECHNOLOGY AFFORDANCE MATRIX: ALL TYPES OF DIGITAL WORK 





Basic 


Intermediate 


Advanced 




Students position and format information to 
fit onto slides. 


Students can import and link to material 
from external sources. 


Students use all elements of production and 
software tools. 






Students can work 

with digital information that comes In differ- 
ent formats. 


Students create a slide show that is elabo- 
rate in transition and presentation, 




Students use text and illustrations that make 
sense together. 


Students use text. 

visuals end sound to clarify and elaborate on 
main idea. 


Students use different forms of representation 
to highlight different aspects of the information. 




Students decide whet to show /what is 
important. 


Students use a layout/ 

format that emphasizes the ideas they think 

are important. 


Students' style or aesthetics are used to per - 
suasively or effectively convey a point of view. 






Students use visual/ 
aural material that 

conveys their particular point of view. 
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Students provide Information necessary for 
a particular audience. 


Students choose rhythm/pacing/transitions 
that appeal to the aucfience. 


Students structure their presentations to aBow 
for audience interaction- 








Students use different media to make their 
messages clear for particular audiences. 


Students use different media to make their 
messages clear and appealing to particular 
audiences. 




II. CONCEPTUAL FRAMEWORK: LIVE PRESENTATIONS 
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TEACHER COMMENTS 
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IV. EVALUATION SAMPLE: LIVE PRESENTATION 
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also broadly introduce the learning opportunities that each area of technology use can afford to students. 
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II. LIVE PRESENTATIONS CONCEPTUAL FRAMEWORK 





Basic 


Intermediate 


Advanced 


1© 


Students position and 
format information to fit 
onto slides. 


Students can import 
and link to material from 
external sources. 


Students use all ele- 
ments of production and 
software tools. 






Students can work 
with digital information 
that comes in different 
formats. 


Students create a slide 
show that is elaborate in 
transition and presentation. 




Students use text and 
illustrations that make 
sense together. 


Students use text, 
visuals and sound to clar- 
ify and elaborate 
on main idea. 


Students use different 
forms of representation to 
highlight different aspects 
of the information. 


Pte0OD2 Msra 


Students decide what to 
show /what is important. 


Students use a layout/ 
format that emphasizes 
the ideas they think are 
important. 


Students’ style or aesthet- 
ics are used to persuasive- 
ly or effectively convey a 
point of view. 






Students use visual/ 
aural material that 
conveys their particular 
point of view. 




£toc£&3OQ0© 


Students provide infor- 
mation necessary for a 
particular audience. 


Students choose 
rhythm/ pacing/transi- 
tions that appeal to the 
audience. 

Students use different 
media to make their mes- 
sages clear for particular 
audiences. 


Students structure their 
presentations to allow for 
audience interaction. 

Students use different 
media to make their mes- 
sages clear and appealing 
to particular audiences. 
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CONCEPTUAL FRAMEWORKS: Diagnostic tools. For each type of work described in the Technology Affordances 
Matrix (e.g. Live Presentations or Internet Research), the Conceptual Frameworks will divide the four skill areas of 
Digital Skill, Media and Meaning, Point of View, and Audience (see Description of the Toolkit for definitions of these 
skill areas) into Basic, Intermediate, and Advanced skills, and provide essential descriptions of each skill level. 
Teachers will be able to use the Frameworks as roadmaps to determine students’ levels of technology use, and focus 
upon the kinds of skills the students must learn to become more sophisticated users. In other words, teachers will 
be able to use the Frameworks to understand the trajectory of skill in each particular skill area for each type of stu- 
dent work with technology. 




III. CHECKLIST: Digital Skills 




Checklists: The " meat " of the Toolkit . While the Conceptual Frameworks will provide general descriptions of 
skill areas, the Checklists will give teachers concrete descriptions of specific skills for students to learn. For 
example, where the Media and Meaning affordance in the Framework says broadly that an Advanced live presen- 
tation would be one in which, "different forms of representation are used to highlight different aspects of the infor- 
mation" the checklists will direct teachers to look at each component of a live presentation. The Checklists are 
flexible tools; teachers can pull from the Checklists when planning lessons or when designing rubrics to assess 
student work. 



The Checklist is organized by areas of technology sophistica- 
tion. It outlines four different areas - Digital Skill, Media and 
Meaning, Point of View, and Audience. The more basic of these 
areas depend on specific skills and information to achieve pro- 
ficiency. The more sophisticated areas tend to be goals that 
build on the basic skills, and are thus less detailed. 

A. GETTING INFORMATION INTO A PRESENTATION 

Can students: 

1 . □ Basic: Attach pictures made with or provided within 

the given software (e.g., Clip art in PowerPoint, 
pictures drawn in Kid Pix)? 

2. □ Intermediate: Attach pictures from external sources 

(e.g., other software, CD-ROMs, digital cameras, the 
Internet)? 

3. □ Intermediate: Scan and import visual material? 

4. □ Intermediate : Import and embed digital video? 

5. □ Intermediate : Import and attach sound files? 

6. □ Intermediate : Embed links to web resources? 

7. □ Intermediate: Import animated material from other 

software? 

B. USING THE MULTIMEDIA CAPABILITIES OF SOFTWARE 
AND PRODUCTION TOOLS 

Can students: 

1 . □ Basic: Use transition effects that come with the 

software? 

2. □ Basic: Use animation effects that come with the soft- 

ware? 

3. □ Basic: Use sound effects that come with the software? 

4. □ Basic: Use drawing tools that come with the software? 

5. □ Basic: Record sound? 

6. □ Intermediate: Record digital video? 

7. □ Advanced: Create animation effects? 
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C. POSITIONING MATERIAL ON A SLIDE 

Can students: 

1 . □ Basic: Place text in different components on a slide 

(e.g., title, body, etc.)? 

2. □ Basic: Manipulate text and pictures (cut and paste)? 

3. □ Basic: Align objects in relation to one another (move 

groups of objects, turn objects, etc.)? 

D. FORMATTING MATERIAL IN A PRESENTATION 

Can students: 

1. □ Basic: Choose an appropriate template when creating a 

new file? 

2. □ Basic: Format text (e.g., change font size, change color 

of text)? 

3. □ Basic: Manipulate the size of slide elements 

(e.g., images, title box, text boxes, etc.)? 

4. □ Basic: Format objects and background(s) (e.g., alter 

color, line, fill effects, etc.)? 

E. STRUCTURING THE PRESENTATION 

Can students: 

1 . □ Basic: Create multiple slides? 

2. □ Basic: Change the sequence of slides? 

3. □ Basic: Combine slides from multiple files into one slide 

show? 

4. □ Intermediate: Manipulate the timing of animated 

transitions? 

5. □ Intermediate: Create custom slide templates? 

6. □ Advanced: Create nonlinear navigational structures for 

their presentation (e.g., create links within the 
presentation that allow them to skip to other parts of 
the presentation)? 
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ill. CHECKLIST^ Media and Meaning 



A. SPOKEN NARRATIVE 

Can students: 

1 . □ Basic: Accompany the slide presentation with a spoken 

narrative that elaborates the material in their slides? 

2. □ Basic Explain how illustrations relate to information in 

text (or make it evident in the product)? 

B. TEXT 

Can students: 

1 . □ Basic Write in a style oriented toward presentations, 
keeping text clear and concise, rather than writing in a 
report style, in which text is more narrative and 
elaborate? 

C. ILLUSTRATIONS (STILL/ MOVING) 

Can students: 

1 . □ Basic: Choose illustrations that support the meaning of 

the presentation? 

2. □ Intermediate: Use visuals to supplement, clarify, or 

elaborate upon information being conveyed in the 
text? 

3. □ Advanced: Choose and employ different forms of 

representation (e.g., data tables, charts) depending 
upon which form most effectively highlights the 
information they wish to emphasize? 

D. SOUND EFFECTS 

Can students: 

1 . □ Basic: Choose sound effects that support the meaning 

of the presentation? 

2. □ In term ediate: Use sound effects to supplement, clarify, 

or elaborate upon information being conveyed in the 
text? 

E. TRANSITIONS 

Can students: 

1 . □ Basic: Choose animated transitions that support the 

meaning of the presentation? 

2. □ Intermediate : Use animated transitions to supplement, 

clarify or elaborate upon information being conveyed 
in the text? 



F. MIX OF MEDIA 

Can students: 

1 . □ Basic: Combine text, visual, and audio materials that 
relate to one another? 

G. LAYOUT 

Can students: 

1 . □ Basic: Organize text and visual elements of a slide 

around a coherent idea (e.g., does the order of the 
slides present sensible narrative)? 

2. □ Basic: Lay out their slides so that each element is 

legible to the viewer? 

3. □ Intermediate: Organize text and visual elements of a 

single slide around a coherent idea, with each 
element conveying distinct information (i.e., can the 
student explain the reasons for the grouping and 
distribution of information across slides)? 

H. DISTRIBUTION OF INFORMATION 

Can students: 

1 . □ Basic Put slides in an order that creates a sensible 

narrative or presents a logical sequence of ideas? 

2. □ Intermediate: Choose how to group and distribute 

information across slides and explain the reasoning 
for this distribution? 

I. PACING: 

Can students: 

1 . □ Intermediate : Time slide changes, transitions, and 

animation to match the flow of the spoken narrative? 






SIL OlEG&CLISTs Point of View 
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A. SPOKEN NARRATIVE 

Can students: 

1 . □ Basic: Definitively clarify and support their point of 
view when asked pointed questions about the 
presentation? 

B. TEXT 

Can students: 

1 . □ Basic: Explain their choices about what text to include, 

based on their point of view about the material? 

2. □ intermediate: Include other viewpoints within their 

presentation? 

3. □ Advanced: Include a discussion of multiple viewpoints 

that illustrates their depth of understanding and 
rationale behind their point of view? 

C. ILLUSTRATIONS (STILL/MOVING) 

Can students: 

1 . □ Basic: Explain their choices about what illustrations to 

include, based on their point of view about the 
material? 

2. □ Intermediate: Select appropriate images to support 

their interpretations of their content material? 

3. □ Intermediate: Explain how the illustrations they have 

selected communicate their interpretation? 

4. □ Advanced: Use illustrations to present multiple view- 

points? 

D. SOUND EFFECTS 

Can students: 

1 . □ Basic: Explain their choices about what sound to 

include, based on their point of view about the 
material? 

2. □ Intermediate: Select appropriate sounds to support 

their interpretations of the content material? 

3. □ Intermediate: Explain how the sounds they have 

selected communicate their interpretation or 
perspective? 

4. □ Advanced: Use sound to present multiple viewpoints? 

E. TRANSITIONS 

Can students: 

1 . □ Basic: Explain their choices about what transitions to 
include, based on their point of view about the 
material? 



2. □ Intermediate: Select appropriate transitions to support 

their perspectives on or interpretations of their 
content material? 

3. □ Intermediate: Explain how the transitions they have 

selected communicate their interpretation or 
perspective? 

4. □ Advanced: Use transitions to present multiple 

viewpoints? 

F. MIX OF MEDIA 

Can students: 

1. □ Intermediate: Combine text, visual, and audio elements 
to effectively convey their points of view? 

G. LAYOUT 

Can students: 

1. □ Bas/c: Make aesthetic choices about the overall 

appearance of the presentation? 

2. □ Intermediate: Employ an aesthetic consistently across 

the presentation? 

3. □ Intermediate: Relate aesthetic choices to the content of 

their presentation? 

4. □ Intermediate: Use layout to highlight the elements of 

their presentation they deem important? 

5. □ Advanced: Use elements of style to promote their 

point of view (e.g., using irony or humor to undercut 
opposing arguments or austerity to lend authority to 
assertions)? 

H. DISTRIBUTION OF INFORMATION 

Can students: 

1 . □ Intermediate: Choose how to group and distribute 

information across slides to emphasize information 
that strengthens their points of view? 

2. □ Intermediate: Order their presentation slides in a 

manner that powerfully presents their points of view? 

I. PACING 

Can students: 

1. □ Intermediate: Choose slide changes, pauses, 

transitions and animation that help convey their 
points of view more effectively? 





IV 
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III. CHECKLIST: Audience 



A. SPOKEN NARRATIVE 

Can students: 

1 . □ Intermediate: Address the audience's questions and 

incorporate their questions and points of interest into 
the narrative? 

2. □ Advanced: Tailor their presentations to speak directly to 

a particular audience's perspective? 

B. TEXT 

Can students: 

1 . □ Basic: Include verbal information that their audience 
needs in order to understand the presentation? 

C. ILLUSTRATIONS (STILL/MOVING) 

Can students: 

1 . □ Basic: Include visual information that their audience 

needs in order to understand the presentation? 

2. □ Intermediate: Use visuals, sounds and layout to draw 

connections between content material and the 
audience’s personal experience? 

3. □ Advanced: Choose illustrations whose appearance will 

appeal and be comprehensible to the intended 
audience (and explain these choices)? 

D. SOUND EFFECTS 

Can students: 

1 . □ Intermediate: Use sounds to draw connections 

between content material and the audience’s personal 
experience? 

2. □ Advanced: Choose sound effects with clear meaning 

that will appeal to a particular audience (and explain 
these choices)? 

E. TRANSITIONS 

Can students: 

1 , □ Advanced : Use rhythm, pacing and transitions that will 
be appealing and comprehensible to a particular 
audience (and explain these choices)? 



F. MIX OF MEDIA 

Can students: 

1 . □ Advanced: Combine text, visual and audio elements 
that are particularly effective with their specific 
audience? 

G. LAYOUT 

Can students: 

1 . □ Intermediate: Use layout to draw connections between 

content material and the audience's personal 
experience? 

2. □ Advanced: Anticipate areas that an audience might 

want to linger over, and design the structure of the 
presentation to respond to those concerns (i.e., 
employ nonlinear navigation structures to respond 
flexibly to audience questions and comments- to refer 
back to and elaborate on their slides, to answer 
questions from the audience, or to help interpret 
ideas for their audience)? 

H. DISTRIBUTION OF INFORMATION 

Can students : 

1 . □ Advanced: Organize information in their slides to 

foster understanding and speak to the issues of the 
intended audience (e.g., choose to distribute 
information across slides that will have the most 
impact on the intended audience)? 

I. PACING 

Can students: 

1, □ Advanced: Choose slide changes, pauses, transitions, 
tempo, and animation that will be appealing and com- 
prehensible for their audience? 






EVALUATION SAMPLE: 

Assessing a Sample Piece of Student Work Using the Evaluation Toolkit 



An expedition of a lifetime with 
Ann Bancroft and Liv Amesen! 

Ann Bancroft and Liv Amesen started an 
expedition. They are trying to cross Antarctica. 
This is a dream come true for them. They have 
prepared to be the first women to have finished 
this challenge. They started on November 13, 2000. 




The expedition begins 

They started on November 13, 2000. They were 
hoping this trip will be finished in about 100 
days, finishing on February 15, 2001 . 




To prove we’re tough enough! 

All the men in the world think they’re tougher than 
women. Liv Amesen and Ann Bancroft proved 
that women are just as tough and that anyone can 
do the impossible! They have proved that anyone 
can work hard and achieve their goals. 




Surviving a frightening challenge 

Bancroft and Amesen had to suffer a lot. They traveled a 
distance of 2,400 miles in the blistering cold and wind. 

The temperature was 30 degrees below, on average, 
and the wind speed was 32-60km/hr. 

In Chicago, the average 
temperature last winter was 15 
degrees. 




Note to Reader: In the following pages, we present and evaluate a sample piece of student 
work. Please note that while we present this work here in black and white, 
the original sample was created in color; comments on the students' 
application of color refer to the original work. 





16 



IV. EVALUATION SAMPLE 

Student Slide 1 : Digital Skills 



Evaluation Sample: How the Too/kit can be used with student work. While the Checklist provides teachers with 
specific skills that students should learn, the Evaluation Sample gives teachers a model of how to apply the 
Checklist to a piece of student work. On the right is a slide created by a student and a description of how the slide 
was presented. On the left is a marked checklist that outlines the areas that the student has mastered. Finally, 
the right page features a sample teacher evaluation, outlining what the student was able to accomplish and the 
skills she still needs to work on. 



A. GETTING INFORMATION INTO A PRESENTATION 

Can students: 



1 . □ Basic: Attach pictures made with or provided within 

the given software (e.g., Clip art in PowerPoint, 
pictures drawn in Kid Pix)? 

2. d intermediate: Attach pictures from external sources 

(e.g., other software, CD-ROMs, digital cameras, the 
Internet)? 



3. □ Intermediate: Scan and import visual material? 

4. □ intermediate: Import and embed digital video? 

5. □ Intermediate: Import and attach sound files? 

6. □ intermediate: Embed links to web resources? 

7. □ intermediate : Import animated material from other 

software? 



B. USING THE MULTIMEDIA CAPABILITIES OF SOFTWARE 
AND PRODUCTION TOOLS 



Can students: 

1 . ^ Basic: Use transition effects that come with the 

software? 

2. M Basic: Use animation effects that come with the soft- 

ware? 

3. ^ Basic: Use sound effects that come with the software? 

4. □ Basic: Use drawing tools that come with the software? 

5. □ Basic: Record sound? 

6. □ Intermediate : Record digital video? 

7. □ Advanced: Create animation effects? 



D. FORMATTING MATERIAL IN A PRESENTATION 

Can students: 

1 . ^ Basic: Choose an appropriate template when creating a 

new file? 

2. ^ Basic: Format text (e.g., change font size, change color 

of text)? 

3. □ Basic: Manipulate the size of slide elements 

(e.g., images, title box, text boxes, etc.)? 

4. □ Basic: Format objects and background(s) (e.g., alter 

color, line, fill effects, etc.)? 



E. STRUCTURING THE PRESENTATION 

Can students: 

1 . ^ Basic: Create multiple slides? 

2. ^ Basic: Change the sequence of slides? 

3. ^ Basic: Combine slides from multiple files into one slide 

show? 

4. □ Intermediate : Manipulate the timing of animated 

transitions? 

5. D Intermediate: Create custom slide templates? 

6. □ Advanced: Create nonlinear navigational structures for 

their presentation (e.g., create links within the 
presentation that allow them to skip to other parts of 
the presentation)? 



C. POSITIONING MATERIAL ON A SLIDE 

Can students: 

1 . ^ Basic: Place text in different components on a slide 

(e.g., title, body, etc.)? 

2. s/ B asic: Manipulate text and pictures (cut and paste)? 

3. M Basic: Align objects in relation to one another (move 

groups of objects, turn objects, etc.)? 




;/) 



0 




STUDENT SLIDE I: 



— STUDENT NARRATIVE: 



Presentation Effects: In this slide, the text is pres- 
ent with no effect. Then the title appears, accompa- 
nied by a “laser" sound effect. Next the left picture 
“drops in" accompanied by a “flying" sound effect, 
and the right picture “appears." 



“Our presentation is about Ann Bancroft and Liv Arnesen. 
They are the first women to cross Antarctica. This is their 
dream come true!” 



An expedition of a lifetime with 
Ann Bancroft and Liv Arnesen! 

Ann Bancroft and Liv Arnesen started an 
expedition. They are trying to cross Antarctica. 
This is a dream come true for them. They have 
prepared to be the first women to have finished 
this challenge. They started on November 13, 2000. 




TEACHER COMMENTS 



THE STUDENTS WERE ABLE TO: 

& u\ difftfeKt location] op\ fkz j(ide- 

ft &U aj^d bod^jJ. 

lAjt u\ expropriate, for*wcctj ftitfe &s\d bod^jJ. 

& CAoOjt <5L bcLCfcpjfoiAt^d 

& jpyert dejiTed joiAP\dj trc^jitiok^, a^jd c^Jj^ja,tioP\ 
efftcfj . 

0 •fvKtvui-t te^t (e.p., foKt j&z, 

co/or of tepfj. 

ERIC 



STUDENTS STILL NEED HELP WITH: 

& ftdvou^cU^y to tke j kder^^dicde f\dvcu*x-ed 

levetj. 
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IV. EVALUATION SAMPLE: 

Student Slide 2: Media and Meaning 



A. SPOKEN NARRATIVE 

Can students: 

1 . ^ Basic: Accompany the slide presentation with a spoken 

narrative that elaborates the material in their slides? 

2. ^ Basic Explain how illustrations relate to information in 

text (or make it evident in the product)? 



F. MIX OF MEDIA 

Can students: 

1. B Basic: Combine text, visual, and audio materials that 
relate to one another? 



B. TEXT 

Can students: 

1 . ^ Basic: Write in a style oriented toward presentations, 
keeping text clear and concise, rather than writing in a 
report style, in which text is more narrative and 
elaborate? 

C. ILLUSTRATIONS (STILL/MOVING) 

Can students: 

1 . ^ Basic: Choose illustrations that support the meaning of 

the presentation? 

2. d Intermediate: Use visuals to supplement, clarify, or 

elaborate upon information being conveyed in the 
text? 

3. □ Advanced: Choose and employ different forms of 

representation (e.g., data tables, charts) depending 
upon which form most effectively highlights the 
information they wish to emphasize? 

D. SOUND EFFECTS 

Can students: 

1 . □ Basic: Choose sound effects that support the meaning 

of the presentation? 

2. □ Intermediate: Use sound effects to supplement, clarify, 

or elaborate upon information being conveyed in the 
text? 



G. LAYOUT 

Can students: 

1 . B Basic: Organize text and visual elements of a slide 

around a coherent idea (e.g., does the order of the 
slides present sensible narrative)? 

2. fif Basic: Lay out their slides so that each element is 

legible to the viewer? 

3. B Intermediate: Organize text and visual elements of a 

single slide around a coherent idea, with each 
element conveying distinct information (i.e., can the 
student explain the reasons for the grouping and 
distribution of information across slides)? 



H. DISTRIBUTION OF INFORMATION 

Can students: 

1 . B Basic: Put slides in an order that creates a sensible 

narrative or presents a logical sequence of ideas? 

2. B Intermediate : Choose how to group and distribute 

information across slides and explain the reasoning 
for this distribution? 



I. PACING: 

Can students: 

1 . □ Intermediate: Time slide changes, transitions, and 

animation to match the flow of the spoken narrative? 



E. TRANSITIONS 

Can students: 

1 . □ Basic: Choose animated transitions that support the 

meaning of the presentation? 

2, □ Intermediate : Use animated transitions to supplement, 

clarify or elaborate upon information being conveyed 
in the text? 



o 

ERIC 
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STU^EPJT SLIDE gg; 
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— STUDENT NARRATIVE: 



Presentation Effects: In this slide, first the title and 
text "appear," then the picture "drops in" very 
slowly. The picture is accompanied by a "drive-in" 
sound effect. 



“Ann and Liv started their trip on November 13th, 2000. 
They wanted to be finished by February 15th, but they 
actually finished four days earlier, which is pretty cool 
because they must have gone really fast. This is a picture 
of when Ann and Liv first arrived: they laid all of their 
equipment on the snow to make sure they had everything 
they needed.” 



The expedition begins 

They started on November 13, 2000. They were 
hoping this trip will be finished in about 100 
days, finishing on February 15, 2001. 




TEACHER COMMENTS 



THE STUDENTS WERE ABLE TO: 

& 6 iwf ofyvL&f iot\ their )/ide) <s- 

cohereKt )ecp\ewce. fhi) )lide ixtrod\ACe) o^e 
ffToa\d of the ^c^rrcrtive lk the jecpAewce: the 
prop re)) of the expedition. 

& f elect theme to prejent in a, )inp/e j/ide — 

title , teX^f &~nd picture <s-// coKtribv&e to <s. )inp/e 
coherent point 

& ’Ei ) (pl^dn how the cho)en photopfaph convey) 
information thect contribute) to the overall ^ 
* e))*pe of the j/ide. ' 

ERIC 



STUDENTS STILL NEED HELP WITH: 

4? CJ^oojinp jo\Ak\d effect) that f^cifitcde their 
prejentz-tion. 

4? [Ajiwf animation effect) in we^y) that do not 
dijrvpt the rhythm./ ttminp of their 
prejeKtection. 
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IV. EVALUATION SAMPLE 

Student Slide 3: Point of View 



A. SPOKEN NARRATIVE 

Can students: 

1 . ^ Basic: Definitively clarify and support their point of 
view when asked pointed questions about the 
presentation? 

B. TEXT 

Can students: 

1 . Gif Basic: Explain their choices about what text to include, 

based on their point of view about the material? 

2. □ Intermediate: Include other viewpoints within their 

presentation? 

3. □ Advanced: Include a discussion of multiple viewpoints 

that illustrates their depth of understanding and 
rationale behind their point of view? 

C. ILLUSTRATIONS (STILL/MOVING) 

Can students; 

1 . ^ Basic: Explain their choices about what illustrations to 

include, based on their point of view about the 
material? 

2. M Intermediate: Select appropriate images to support 

their interpretations of their content material? 

3. Intermediate: Explain how the illustrations they have 
selected communicate their interpretation? 

4. □ Advanced: Use illustrations to present multiple view- 

points? 

D. SOUND EFFECTS 

Can swdents: 

1 . H Basic: Explain their choices about what sound to 

include, based on their point of view about the 
material? 

2. ^ Intermediate : Select appropriate sounds to support 

their interpretations of the content material? 

3. □ Intermediate: Explain how the sounds they have 

selected communicate their interpretation or 
perspective? 

4. □ Advanced: Use sound to present multiple viewpoints? 

E. TRANSITIONS 

Can students: 

1 . □ Basic: Explain their choices about what transitions to 
include, based on their point of view about the 
material? 



2. □ Intermediate : Select appropriate transitions to support 

their perspectives on or interpretations of their 
content material? 

3. □ Intermediate : Explain how the transitions they have 

selected communicate their interpretation or 
perspective? 

4. □ Advanced: Use transitions to present multiple 

viewpoints? 

F. MIX OF MEDIA 

Can students: 

1 . ^ Intermediate: Combine text, visual, and audio elements 
to effectively convey their points of view? 

G. LAYOUT 

Can students: 

1 . ^ Basic: Make aesthetic choices about the overall 

appearance of the presentation? 

2. ^ Intermediate : Employ an aesthetic consistently across 

the presentation? 

3. □ Intermediate : Relate aesthetic choices to the content of 

their presentation? 

A. □ Intermediate: Use layout to highlight the elements of 
their presentation they deem important? 

5. □ Advanced: Use elements of style to promote their 

point of view (e,g., using irony or humor to undercut 
opposing arguments, or austerity to lend authority to 
assertions)? 

H. DISTRIBUTION OF INFORMATION 

Can students: 

1 . tif Intermediate: Choose how to group and distribute 

information across slides to emphasize information 
that strengthens their points of view? 

2. Intermediate : Order their presentation slides in a 
manner that powerfully presents their points of view? 

I. PACING 

Can students: 

1. □ Intermediate : Choose slide changes, pauses, 

transitions, and animation that help convey their 
points of view more effectively? 






STUDENT SLIDE BIB; 
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— STUDENT NARRATIVE: 



Presentation Effects: In this slide, first the title and 
text “appear," then the picture “drops in" very 
slowly. The picture is accompanied by a “drive-in" 
sound effect. 



“All of the other kids picked explorers who were men, 
like Shackleton or Magellan, but we chose Ann and Liv 
because they proved that women can be great explorers, 
too. Just look at how tough they are! They are sooooo 
tough!” 



To prove we’re tough enough! 

All the men in the world think they’re tougher than 
women. Liv Amesen and Ann Bancroft proved 
that women are just as tough and that anyone can 
do the impossible! They have proved that anyone 
can work hard and achieve their goals. 




TEACHER COMMENTS 



THE STUDENTS WERE ABLE TO: 

& LAjc picture]. that UUjtrcctc their poiKt that /\t^\ 
eu^d fiv were fo\ACfk explorer]. 

& Qhoo]e a. title, that hiffh/ipht] their poixt. 

& Stpla-t how their cho]etv joiA^d effect coweyj their 
pout of view. 

& f'ja.fce c^ejtbetcC choice] toit the overtoil appea.raa^ce 
of the prejeKtatioh^. ~j~heje choice] were 
derv\o^]tr<ted u\ the ffadeit] coiv]i]teKt cu\d 
ore] caviled color choice] eu^d their expropriate 

Q dectioiv of photograph] thrcuAphoit. 

ERIC 



& fzrvploy eu\ aejthetic cotvjiftett/y c^croj] the 

pre]ett ; .ow, the a-ejthetic format wa] recfi^lcjC eu\d 
ea.]oj to iAtvderftaj\d. 



STUDENTS STILL NEED HELP WITH: 

0 jwd\Adu^ eu\d di]CiA]]U*p other per]pective] ot\ the 
]vj?ject ri+jctter a.] a. yvieeu*] for edpIcUstsp/ t^d 
]trehjythewi*p/ hheir owtv pout of view. 
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SV. EVALUATION SAMPLE 
Student Slide 4: Audience 



A. SPOKEN NARRATIVE 

Can students: 

1 . □ Intermediate: Address the audience’s questions and 

incorporate their questions and points of interest into 
the narrative? 

2. Advanced: Tailor their presentations to speak directly to 
a particular audience’s perspective? 

B. TEXT 

Can students: 

1 . Basic: Include verbal information that their audience 
needs in order to understand the presentation? 

C. ILLUSTRATIONS (STILL/MOVING) 

Can students: 

1 . ^ Basic: Include visual information that their audience 

needs in order to understand the presentation? 

2. 5 f Intermediate: Use visuals, sounds, and layout to draw 

connections between content material and the 
audience’s personal experience? 

3. □ Advanced : Choose illustrations whose appearance will 

appeal and be comprehensible to the intended 
audience (and explain these choices)? 

D. SOUND EFFECTS 

Can students: 

1 . □ Intermediate : Use sounds to draw connections 

between content material and the audience's personal 
experience? 

2. □ Advanced: Choose sound effects whose meaning will 

be clear and whose effect will appeal to a particular 
audience (and explain these choices)? 

E. TRANSITIONS 

Can students: 

1 . □ Advanced: Use rhythm, pacing, and transitions that will 
be appealing and comprehensible to a particular 
audience (and explain these choices)? 



F. MIX OF MEDIA 

Can students: 

1 . Advanced : Combine text, visual, and audio elements 

that are particularly effective with their specific 
audience? 

G. LAYOUT 

Can students: 

1 . ^ Intermediate: Use layout to draw connections between 

content material and the audience’s personal 
experience? 

2. □ Advanced: Anticipate areas that an audience might 

want to linger over and design the structure of the 
presentation to respond to those concerns (i.e., 
employ nonlinear navigation structures to respond 
flexibly to audience questions and comments- to refer 
back to and elaborate on their slides, to answer 
questions from the audience, or to help interpret 
ideas for their audience)? 

H. DISTRIBUTION OF INFORMATION 

Can students: 

1 . □ Advanced: Organize information in their slides to 

foster understanding and speak to the issues of the 
intended audience (e.g., choose to distribute 
information across slides that will have the most 
impact on the intended audience)? 

I. PACING 

Can students: 

1 . □ Advanced: Choose slide changes, pauses, transitions, 
tempo, and animation that will be appealing and com- 
prehensible for their audience? 






STUDENT SLIDE IV: 



STUDENT NARRATIVE: 



Presentation Effects: In this slide, the title is pres- 
ent with no effects. Then the Antarctica facts and 
picture “appear.” Next, the Chicago fact and pic- 
ture “appear.” 



“Ann and Liv had to ski across almost 2,400 kilometers of 
ice and snow on their expedition. It was much colder in 
Antarctica than it is on a winter day here. The temperature 
was 30 degrees below zero, on average, and the wind 
speed was 32-60 km/hr. Think about how cold you felt 
coming to school every day this winter, but this winter the 
average temperature in Chicago was 15 degrees - that’s 
45 degrees warmer than in Antarctica." 



Surviving a frightening challenge 

Bancroft and Amesen had to suffer a lot. They traveled a 
distance of 2,400 miles in the blistering cold and wind. 

The temperature was 30 degrees below, on average, 
and the wind speed was 32-60km/hr. 

In Chicago, the average 
temperature last winter was 
15 degrees. 




TEACHER COMMENTS 



THE STUDENTS WERE ABLE TO: 

& Qyeccte o- prejentectiob. to which the audience cov\(d 
rejccte. (fjot^pc^re the weecther u\ /\bjiz.rcti ice^ with 
the weather lp\ QJhicc<Jjo, cu^jd v\je ^ picture of 
ffi^dentj thcct the audience lp\ 6- wowjd 

& jfcjp nuz-jze the cohj^ectiob. between the tbf or*bccttob 
provided u\ the fctf cu*jd vijw^jj {two picture,], in thij 
inffancej throiAC/h their jpofcen ncCrfative by c^jtdbp 
jtAdentj to compare their own winter weecther to 
/W'- and fivj experience. 

ERjt 



STUDENTS STILL NEED HELP WITH: 

& fejectinp c*n uwzjje thcct clearly conveyj the contfaft 
they c^re dfawinp. ~f~he inu^e they ] ejected conveyj 
ju*iijcLriiy, father then difference. 

& /jjiAjtfatinp their reference to tc*ApcfatvyTc differencej 
on e. rwap with picture or yfaph thect wov\jd 
the difference between f\btc^rctic&- end 
QJhiccujo vijibje to their cje-jjroon*. cmdience. 
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